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I  ABSTRACT 

V 

Derivations  and  programs  are  presented  for  evaluation  of  the  required 
input  deflection,  for  specified  output  deflection,  of  a  system  composed  of 
quantizers  followed  by  a  Greatest-Of  device  and  an  integrator.  The  important 
parameters  are:  L,  the  number  of  levels  in  each  quantizer  (along  with 
their  breakpoints  and  step  heights) ;  M,  the  number  of  statistically 
Independent  samples  summed  in  t|ie  integrator;  N,  the  number  of  statistically 
Independent  input  channels;  and  the  system  output  deflection.  Several 
numerical  examples  are  presented.  Extension  of  some  earlier  results  for 
a  system  without  quantizers  (Ref.  1)  is  also  made,  and  additional  results 
given. 
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INTRODUCTION 

Practical  realizations  of  desired  systems  often  incorporate  approximations 
to  ideal  devices,  for  the  sake  of  expense  and  equipment  complexity.  In 
particular,  quantization  is  frequently  employed,  since  it  facilitates  data 
processing.  In  an  earlier  study  (Ref.  1),  the  required  input  signal-to-noise 
ratio  for  a  Greatest-Of  device  followed  by  an  integrator  was  determined; 
here,  we  wish  to  extend  the  analysis  to  a  system  which  also  has  quantization 
prior  to  the  Greatest-Of  device.  Surprisingly,  it  will  turn  out  that  the 
analysis  of  this  more-complicated  data  processor  is  much  simpler  and  quicker 
(via  computer  aid)  than  that  of  the  earlier  system  without  quantization. 

It  is  advantageous  for  the  reader  to  be  familiar  with  the  assumptions, 
notation,  and  results  of  Ref.  1  before  reading  this  memorandum. 


SYSTEM  DEFINITION  AND  ASSUMPTIONS 

The  system  of  interest  is  depicted  in  figure  1.  The  input  channels 
*1'  ****  *N  are  aaaumed  statistically  Independent  and  contain  either  (a) 
no  signal  in  any  channel,  or  (b)  signal  in  one  channel  only.  (A  method 
for  handling  statistlcally-dependent  inputs,  by  defining  an  effective 
number  of  statistically- independent  channels,  is  described  in  appendix  A. 

Thus  the  present  results  are  applicable  to  a  wider  class  of  inputs  than 
presumed  here,  under  proper  interpretation  of  the  value  of  N.)  The 
probability  density  functions  of  a  single  channel  random  variable  x,  under 
the  two  hypothesis  (a)  and  (b),  are  denoted  by  pQ(x)  and  p^(x),  respectively, 
for  the  noise-only  channels  and  the  signal-bearing  channel.  The  noise-only 
channels  are  identically-distributed;  however,  the  analysis  could  be 
extended  to  the  case  of  different  distributions  on  each  channel. 

The  Greatest-Of  device  is  described  mathematically  by 

lj  =  (*, -ffa)}.  (1) 

Now  we  shall  limit  consideration  to  non-linear  no-memory  devices  f  that 
are  monotonically  non-decreasing;  that  is 
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■p(fl)  i  fU>)  if  «< 


Then  (1)  can  be  written  in  the  equivalent  form 


Jj  =  f  (*flx£x,r-;Xw}). 


This  implies  that  the  system  in  figure  2  is  equivalent  to  that  of  figure  1, 
when  (2)  is  satisfied.  In  practice,  figure  1  might  be  preferred  for  a 
quantizer  f,  because  the  Greatest-Of  device  need  only  handle  a  discrete 
set  of  inputs,  rather  than  the  continuous  inputs  in  figure  2.  The  reason 
for  pointing  out  (3)  is  that  the  processor  in  figure  2  is  more  convenient 
to  analyze  than  figure  1;  however,  the  system  of  figure  1  is  capable  of 
analysis  for  a  general  non-monotonic  quantizing  nonlinearity  f,  as  will 
become  apparent  by  the  methods  to  follow. 

The  output  of  the  Integrator  in  figures  1  and  2  is  assumed  to  consist 
of  a  sum  of  M  statistically-independent  samples.  (For  a  discrete  sum  of 
dependent  samples,  an  effective  number  of  independent  samples  can  be 
defined  in  a  manner  identical  to  that  in  Appendix  A;  see  Ref.  2,  Appendix  B. 
Alternatively,  a  continuous  integration  can  also  be  modelled  as  an  equivalent 
discrete  summation  of  an  effective  number  of  Independent  samples,  by  a 
slight  modification  of  Appendix  A;  see  for  example.  Ref.  3,  Appendix  A. 

Thus,  the  present  results  are  applicable  to  a  wider  class  of  Integrators 
than  presumed  here,  under  proper  Interpretation  of  the  value  of  M.) 


DEFINITION  OF  OUTPUT  DEFLECTION 


Since  the  Integrator  output  is 


Z  *  ) 

n*  I  J 

we  have  for  its  mean  and  variance,  respectively, 

M  s  M  Oy  , 
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using  the  independence  of  samples  fjj  (Actually,  we  need  only  require 
be  uncorrelated.) 

We  define  a  system  output  deflection  (prior  to  the  threshold  comparison) 
as  the  physically-meaningful  quantity 


(6) 


where  subscripts  0  and  1  denote,  respectively,  the  signal-absent  and  signal- 
present  cases.  In  an  earlier  study  (Ref.  1),  we  presumed  that  output  z 
was  Gaussian  (as  it  would  reasonably  be,  for  large  M).  The  way  this 
assumption  appeared  in  the  results  of  the  earlier  analysis  was  in  the  setting 
of  the  value  of  dQ  in  (6),  for  prescribed  false  alarm  and  detection  probabilities; 
see  Ref.  1,  eqs.  (6)-(!6).  Here,  we  will  not  assume  z  is  Gaussian;  rather, 
we  will  simply  require  deflection  dQ  to  take  values  in  the  neighborhood*, 

3-5,  knowing  that  relatively  good  performance,  in  terms  of  false  alarm  and 
detection  probabilities,  is  then  attainable  through  appropriate  choice  of 
threshold  T  in  figure  1.  The  actual  numerical  values  selected  for  dQ  for 
plotting  purposes  will,  however,  correspond  exactly  to  those  used  earlier*, 
for  comparison  purposes.  The  purpose  of  this  discussion  is  to  point  out  that 
the  results  actually  have  applicability  to  a  wider  class  of  outputs,  z,  than 
presumed  in  the  original  work  (Ref.  1),  under  proper  interpretation  of  dQ  as 
a  physically-useful  (although  statistically  Incomplete)  measure  of  performance. 

Substituting  (5)  m  (6),  we  have 

J 


SPECIALIZATION  TO  QUANTIZERS 

In  order  to  evaluate  (7),  we  need  to  evaluate  the  moments  (see  figure  2) 


-  {^(w)  =  J<iw  j(w)  f  M,  (8) 

*For  example,  -  ^(Py)  ■  3.090  and  4.753  for  Pp  ■  10”  and  10  ,  respectively; 

see  Ref.  1,  eqs.  (16)  and  (10). 
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where  q(w)  is  the  probability  density  function  of  w.  (We  will  impose  subscripts 
0  and  1  when  necessary.)  For  general  monotonic  nonlinearities  f,  this  is  a 
complicated  expression.  However,  when  f  is  a  quantizer,  (8)  takes  a  particularly 
simple  form.  Consider  the  general  monotonic  quantizer  characterization  in 
figure  3.  Without  loss  of  generality,  L  >  1;  otherwise,  the  quantizer  output 
is  independent  of  its  input.  Also  hg  <  for  0  <£  £  L  -  1,  and 

for 


where  Q(w)  is  the  cumulative  distribution  function  of  w.  In  particular,  the 
quantities  needed  in  (7)  are  (re-establishing  subscripts) 

ys>  *  K.-  jf-QiOii)  [S'  'til  i 

Jo 

s  “  /v)  * 


The  cumulative  distribution  functions  of  w  under  the  signal-absent  and 
signal-present  cases,  respectively,  are,  using  the  statistical  independence 
of  {xj,  ....  *  (see  figure  2), 


o,(»)  «  if 


*By  contrast,  the  results  for  no  non-linear  device,  i.e.  f(x)  ■  x,  are  much  more 
complicated;  see  Ref.  1,  eqs.  (17),  (18),  and  (30)  (upper  line). 
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where  P  (x)  and  P. (x)  are  Che  cumulative  distribution  functions  of  x  under 
o  l 

the  signal-absent  and  signal-present  alternatives,  respectively;  see 
Definitions  subsection  above. 


SPECIALIZATION  TO  GAUSSIAN  INPUTS 

This  specialization  to  Gaussian  inputs  is  made  solely  for  the  purpose 
of  evaluating  (10)  and  (11)  for  a  particular  example.  It  is  not  fundamental, 
and  can  be  replaced  by  another  more-appropriate  example  if  desired.  For 
Gaussian  inputs,  we  have 


where  m^,  m^  are  the  means,  and  ( p  is  the  standard  deviation  (assumed  identical), 
for  the  two  signal  hypotheses.  It  is  convenient  to  define  an  input  deflection 
(analagous  to  output  deflection  (6))  as 


<r 


(This  quantity  was  denoted  by  r  in  Ref.  1).  Employing  (11)  and  (12)  in 
(10),  we  can  now  evaluate 

qA)  * 

qa)- 

The  quantizer  break-points  will  be  specified  in  terms  of  input 

parameters  and  (see  figure  1);  i.e.,  let 


b*  =  *  <rVj  ,  or  ;  L, 

where  ^  is  a  "normalized"  breakpoint.  Then  (14)  becomes 
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Q.0*)  -  f(*X 

o,(y  -  tf'X'i)  fGH;). 

where  we  also  utilized  (13).  The  tty}  >*  0s)  c«**  neyabve  or  positive. 


SUMMARY  OF  ANALYTICAL  RESULTS  FOR  QUANTIZERS  PRESENT 


Output  deflection  d^  is  given  by  (7).  The  quantities  needed  in  (7) 
are  given  by  (10).  And  the  latter  quantities  are  given  by  (16).  The  necessary 
input  parameters  are  L,  Wo  .  hX  ,  M,  N,  d^.  A  program  for  the 
evaluation  of  dft  is  given  in  appendix  B.  We  will  set  d_  equal  to  3.090  or 
4.753,  which  as  noted  earlier,  correspond  to  Pp  *  10-  ,  Pp  *  .5  or  Pp,  »  10  , 

Pp  ■  .5  respectively,  and  solve  for  the  required  value  of  input  deflection 
d^,  for  specified  quantizer,  number  of  input  channels,  and  number  of  independent 
samples  in  the  integrator. 

The  quantizer  example  to  be  investigated  is  an  eight-level  (3  bit)  device 
as  shown  in  figure  4.  That  is,  all  the  steps  are  of  equal  spacing  and  height, 
and  extend  from  the  noise-only  mean  m^  to  m^  +  29*.  Thus  from  figure  3  and  (15), 


l<^L  =  7. 


(17) 


We  will  characterlzer  this  spacing  by  av  *  1/3. 


RESULTS 

The  input  deflection,  d^,  required  for  M  -  16  is  presented  in  figure  5, 
as  a  function  of  N,  the  number  of  independent  input  channels.  Similar  results 
for  M  *  32  and  64  are  .presented  in  figures  6  and  7. 

Since  the  quantizer  in  figure  4  only  spans  the  range  (TnQ,  mQ  +  2r) ,  it  is 
anticipated  that  better  performance  might  be  attained  if  the  quantizer  covered 
a  wider  range.  In  figure  8,  a  comparison  of  quantizers  (for  M  -  32)  which 
cover  the  range  (mg,  mg  +  6  4v)  is  made,  for  av  -  1/3,  .5,  and  .7.  It  is 


10 


TM  No. 
781174 


observed  that  best  performance  (lowest  is  realized  when  av  ■  .5; 
that  is,  the  quantizers  then  cover  the  range  (m^,  mp  +  3<T" ) .  Results 
for  other  cases  are  easily  available  by  means  of  the  program  in  appendix  B. 
Jn  ar}  Jowe  <rf  -the  fife]  Co*M  be  if  defied. 
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EXTENSION  OF  EARLIER  RESULTS 

In  Ref.  1,  analytical  and  graphical  results  were  presented  for  the 
system  without  quantizers.  In  particular,  in  Ref.  1,  eqs.  (21)  and  (31), 
the  quantities 

4,  =  N  J  lx  X  'W, 

bN*Nj'd*x,4>M  £""!*),  <18> 

were  found  necessary.  By  use  of  some  results  in  Ref.  4,  closed  form 
expressions  for  some  of  these  quantities  have  been  found,  which  augment 
eqs.  (22)  and  (32)  in  Ref.  1.  They  are  listed  in  Table  1  below. 


M 

i 

0  1 

2 

1/l/rP  \ 

3 

4 

5 

;£(i 7 

Table  l.  Values  of  a^  and  b^ 


The  graphical  results  in  Ref.  1  were  for  very  large  values  of  M. 

Here  we  present  some  additional  results*  for  M  ■  16,  32,  64,  128,  in 
figures  9-10,  respectively.  The  labelling  on  these  figures  corresponds  to 
the  deflection  criteria  cited  earlier  in  this  memorandum,  rather  than  that 
in  Ref.  1.  These  results  also  allow  for  comparison  with  the  quantizer 
results  given  in  figures  5-8  above. 


*A  program  for  the  system  without  quantizers  is  given  in  Appendix  C. 
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Figure  3.  Quantiser  C^o»”<it4e.r/wlii 
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APPENDIX  A.  Definition  of  Effective  Number  of  Independent  Inputs 


Consider  random  variables  Xp  . . . ,  which  are  identically  distributed 

(noise-only  case),  but  not  necessarily  independent.  Define 


Then 


i  = 


»*  i 


(A-l) 


(A-2) 


Let 


and 


Then 


and 


a**  s  o,  oj 


(x„ 


(A-3) 


(A-4) 


(A-5) 


(A-6) 


(A- 7) 


(A-8) 


These  check  intuition. 

So  the  results  in  this  memorandum  could  be  used  for  dependent  inputs 
Xj,  ...,  X^,  if  N  is  replaced  by 
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APPENDIX  B.  Program  for  System  with  Quantizers 


The  following  Basic  program  is  written  for  the  Hewlett  Packard  9845A. 
The  quantizer  parameters  are  entered  in  lines  40,  SO,  and  60.  d^,  N,  and 
M  are  input  in  lines  10,  20,  and  30  respectively. 


10  INPUT  Pi  '  Di>=0  INPUT  DEFLECTION 

20  N»5  '  N  >  *  1  NUMBER  OF  INPUT  CHANNELS 

30  M=32  !  M >  0  HUMBER  OF  TERMS  IN  ACCUMULATOR 

40  L  =  ?  !  L  >=  1  HUMBER  OF  LEVELS  -1  IN  QUANTIZER 

50  DAT A  0 , 1,2, 3, 4, 5*6, 7 

51  REM  L  EQUI-3IZED  VERTICAL  JUMPS  FROM  0  UP  TO  L 

60  DATA  0 , . 33333 * ■ 66667 ,1,1. 33333 , 1 . 66667 , 2 

61  REM  L-l  EQU I -SPACED  HORIZONTAL  JUMPS  FROM  MEAN  TO  2*SIGMA 

70  DIM  A <  © : 7 ) , V < 1 : 7 ) 

30  MAT  READ  H,V 
90  Muy0=Muy  1  L  > 

100  Y02av=HCL>A2 
110  T 1 =N- 1 
120  FOR  L 1  *  1  TO  L 
130  T2=FNP(  V(L1  )  ') 

140  T3=T2AT 1 
150  Q0=T3*T2 

160  Q1*T3*FNP< V<L1 >-Di ) 

170  T4=H<L1 >-H<Ll-l> 

ISO  Muy0=MuyO-Q0*T4 
190  Muy  1 =Muy 1 -Q 1 *T4 

200  Y02av*Y02av-Q0*<H<Ll V2-HCL1 -1  >  '2> 

210  NEXT  LI 

220  Si gy0*SQR<Y02aM-Muy0A2> 

230  Do=SQR<M)*<Muyl-Muy0>/Sigy0  !  OUTPUT  DEFLECTION 

240  PRINT  "L  =";L,"M  «“;M."N  =  "  ;  N 
250  PRINT  “Di  ■" ;Di,"Do  =";Do 
260  STOP 

270  DEF  FNPCP0)  !  PHI 

280  P=ABS <P0> 

290  IF  P<  7  .  THEN  320 

300  P=0 

310  GOTO  350 

320  P»l/f.  1  +  .  2316419*P> 

330  P-P#<  .  31933 153-P*< .  356563782-P* < 1 . 7814779.37-P*<  1 . 82125597S-P*1 . 3302744 

340  P=P*EXPO.  5*P0A2>  *.  398942280401 
350  IF  P0<0  THEN  370 
360  P*l-P 
370  RETURN  P 
38&  FNEND 
390  END 
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APPENDIX  C.  Program  for  System  without  Quantizers 


The  following  Basic  program  is  written  for  the  Hewlett  Packard  9845A 
it  is  essentially  the  same  as  Ref.  1,  appendix  B.  The  inputs  are  r  and  N 


in  lines  30  and  40.  Observation  of  the  comments  in  lines  170-190  is 
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REM  TM  No.  TC- 13-75,  APPENDIX  £ 

28 

REM  NOTICE  LINES  ft ,  B,  C,  AND  D  BELOW 

38 

DEF  FNF  < R  > 

40  A 

t  N=8  ! 

INPUT 

N  >=  2 

50 

C 1  =  1  -'SQR  <  2*P  I  > 

68 

Sl  =  -S 

70 

32  =  8 

30 

33=  <  FNS  <  3 1 , R , N , C 1 >  +FNS  <  32 , R , N , C 1 >  >  * . 5 

• 

90 

S4=8 

188 

35=2 

118 

36=<S2-S1 >*. 5 

120 

S  7 = 2  •'  3 

138 

Loop:  FOR  33=1  TO  35-1  STEP  2 

148 

34=S4+FNS<S1+S6*S8,R,N,C1) 

150 

NEXT  S3 

160 

Fo 1 d=F 

178 

E:  F= <33+ 2* 34) *36*37-. 01541  .  ! 

RHS  OF 

<35>  SUBTRACTED 

138 

C:  IF  S5C123  THEN  200  ! 

NEED  MORE  THEN 

123  ? 

198 

D:  IF  flBS(F-Fo1d)<lE-5  THEN  RETURN  F  ! 

ERROR 

TOLERANCE 

ok:  ? 

200 

33=33+34 

210 

34=8 

228 

35=35*2 

230 

S6=S6* . 5 

248 

GOTO  Loop 

258 

FNENB 

260 

DEF  FNS ( X ,  R ,  N,  C 1  ) 

2T0 

T 1 =FNP <  X ,  C 1  ) 

230 

T2=EXP<-.  5*X-"-2> 

290 

T3=X-R 

308 

IF  N=2  THEN  330 

310 

T4  =  TlXN-2> 

328 

GOTO  348 

330 

T4=  1 

340 

8=C1  *X*T4*<  <N-1  )*T2*FNP<T3,  Cl  >+Tl*EXP <-.  5*T3'"2)-N*T2*T  1  > 

350 

RETURN  3 

360 

FNEHD 

378 

DEF  FNP<P0, Cl >  !  PHI 

330 

P*flBS<P0> 

398 

IF  P< 7  THEN  420 

400 

P  =  0 

410 

GOTO  450 

420 

P=l/< 1+. 2316419+P) 

430 

P=P*< . 31933153-P+C . 356563782-P* < 1 . 73147793 

7-P*  ( 1 . 

S  it’ 1  5  5  ('  b’ 

-P*l . 33 

440 

P»C  1 *P*EXP  <  - :  5*P0  ''2> 

450 

IP  P8<0  THEN  470 

460 

P=l-P 

470 

RETURN  P 

430 

FNEHD 
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